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Abstract 

We examine the effect of an anomalous flavor changing chromo- 
magnetic moment which allows direct top quark production (two par- 
tons combining into an unaccompanied single top quark in the s- 
channel) at hadron colliders. We consider both t-c-g and t-u-g cou- 
plings. We find that the anomalous charm quark coupling parameter 
k c /A can be measured down to .06 TeV _1 (.009 TeV -1 ) at the Teva- 
tron with the Main Injector upgrade(LHC). The anomalous up quark 
coupling parameter k u /A can be measured to .02 TeV _1 (.003 TeV -1 ) 
at the Tevatron(LHC). 

Introduction 



With the discovery of the top quark |I|, , the long anticipated completion of 
the fermion sector of the standard model has been achieved. Its unexpected 
large mass in comparison with the other known fermions suggests that the 
top quark may play a unique role in probing new physics, and has prompted 
both theorists and experimenters alike to search for anomalous couplings 
involving the top quark. On the experimental side, the CDF |3|, |J and DO 
|| collaborations have begun to explore the physics of top quark rare decays 
. On the theoretical side, a systematic examination of anomalous top quark 
interactions, in a model independent way, has been actively undertaken]^, |7|. 
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One possible set of anomalous interactions for the top quark is given by 
the flavor- changing chromo-magnetic operators: 



and 

^g s ca^^tG; u + h.c, (2) 

where A is the new physics scale, k c and k u define the strengths of the 
couplings, and G a is the gauge field tensor of the gluon. The investigation 
of these couplings is well motivated. Although these operators can be induced 
in the standard model through higher order loops, their effects are too small 
to be observable || . Therefore, any observed signal indicating these types of 
couplings is direct evidence for physics beyond the standard model. 

It has been argued that the couplings in Eqs. (1) and (2) may be sig- 
nificant in many extensions to the standard model, such as supersymmetry 
(SUSY) or other models with multiple Higgs doublets || |9|, [LC], [11]], models 
with new dynamical interactions of the top quark|]l2|, and models where the 
top quark has a composite fT3fl or soliton[[n[] structure. In particular, Ref. 



10| suggests that the supersymmetric contributions to a t-c-g vertex may be 



large enough to measure at a future hadron collider. 



T. Han et. al.fl5l have placed a limit on the top-charm-gluon coupling 
strength, k c , by examining the decay of the top quark into a charm quark and 
a gluon. They find an upper limit on k c /A of .43(.65) TeV" 1 with(without) 
b-tagging for 200 pb _1 of data at the Tevatron. If the c and u jets are not 
distinguished, their result applies equally well to K u /A, if one uses the up 
quark coupling alone, or to the sum, added in quadrature, when both are 
considered. 

In this paper, we will examine these operators in a model independent way 
using direct top quark production at the Fermilab Tevatron and at the CERN 
LHC. In this scenario, a charm (or up) quark and a gluon from the colliding 
hadrons combine immediately to form an s-channel top quark, which then 
decays. The production of a single, unaccompanied top or anti-top quark 
is very small in the standard model. For simplicity, we consider couplings 
to the up quark and to the charm quark independently. We will take as 
our signal only the case where the top quark decays to a b quark and a W 
boson. While the t — > eg (or ug) decay will occur in the presence of the 
anomalous couplings given in Eqs. (1) and (2), it is smaller than the t — > bW 
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Figure 1: Feynmann diagram for direct top quark production and subse- 
quent decay into blvi 

decay for k/A ~ .75 TeV -1 , and will have a negligible branching ratio for 
k/A ~ .2 TeV -1 . Given the existing upper bound of the anomalous coupling 
mentioned earlier |]15||, t — > bW will be the dominant decay mode of the top 



quark. Since the W boson decay into a charged lepton (electron or muon) 
and its corresponding neutrino has an identifiable signature, we consider only 
the t — > bW — > blui decay for our signal. With the decays so chosen, we find 
that the backgrounds are manageable, as will be discussed in detail later. 



Direct Top Quark Production 

We have calculated tree level cross sections for direct top quark production, 
pp —> t —>■ bW + — ► bl + b>i, using the flavor-changing chromo magnetic moments 
in Eqs. (1) and (2) (see Fig. [1]). The l + in this process is either a positron or 
an anti-muon, and v\ is its corresponding neutrino. We also included direct 
anti-top production in our calculation (pp —>-t^ bW~ — > bl~Vj). The parton 
cross section for direct top (or anti-top) production is given by: 

i i g _ 2 

da = 2 Ta ^ , 2 l ' Ul \M\ 2 dn b dn l( iMl ui , (3) 

where the spin averaged squared matrix element is 



Ml 



2567r 3 a|a s «^ (u) s(p h -p Vl ) 


8 


[lc(u) ■ Pi) 


+ ™$ ( 


% ■ Pi) 










2 + M^T 2 W \ 



(4) 
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Pb,i,vi are the 4-momenta of the outgoing b quark, lepton, and neutrino re- 
spectively, q c (u),g are the 4-momenta of the incoming charm(up) quark and 
gluon, IV is the decay width of the W boson, 



t-*bW 



1 + 



128M^a 



3« 2 ( 1 - $ 



1 + 2^| 



c (") 

A 



(5) 



is the decay width of the top quark, including the anomalous contribution 
for t — > eg (or t — > -ug), is the standard model top quark decay width 

to a 6 quark and W boson, 



(6) 



is the invariant mass squared, not necessarily on shell, of the W boson, and 
V§ is the parton center of mass energy. 

As mentioned earlier, we considered only the case which has a charged lep- 
ton (muon or electron) in the final state, to identify the W boson. Compared 
to the hadronic decay mode of the W, the background for these processes is 
smaller and the signal is not as hard to identify. In order to examine the kine- 
matics of the decay products, we calculated the full three body phase space 
for the process, using the Breit-Wigner propagators to broaden the top quark 
and W boson distributions. Figure |2| shows the cross section at the Teva- 
tron as a function of K c /A. In the top quark decay width, we included an 
additional term arising from t — > eg, as shown in Eq. (5). This term is pro- 
portional to |k c /A| 2 and contributes significantly to the top quark width only 
if k c /A Z 0.2TeV _1 . One can clearly see the effect of the additional channel 
for top quark decay, which decreases the t — > bW branching ratio and causes 
a noticeable deviation from quadratic behavior for k c /A ~ 0.2 TeV -1 . The 
corresponding cross section for the t-u-g coupling has a similar shape, but is 
approximately an order of magnitude larger. 

We calculated the pp (for the Tevatron) and pp (for the LHC) cross sec- 
tions for direct top production with the MRSA structure functions [0. We 
have also examined the effect of using the CTEQ3M |T7| structure func- 
tions. The difference between the two sets of structure functions is small. 
Several distributions were calculated, including the transverse momenta, the 
pseudorapidities, the jet separation, from the lepton, and the reconstructed 



's. 
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Figure 2: Direct top cross section vs. k c /A at Run 1 of the Tevatron. 

In order to reduce the W + 1 jet background, we made a series of cuts, 
which we will call the basic cuts, on the kinematic distributions. They are: 



p T (b,l,vi) > 25GeV, (7) 

Vb < 2.0, (8) 

m < 3.0, (9) 

AR > 0.4 , (10) 



where rjbj are the pseudorapidities, AR = y (77^ — rji) 2 + (0& — <pi) 2 is the 
separation between the b jet and the charged lepton in the detector, and 
<pb,i are the azimuthal angles. We also assumed a Gaussian smearing of the 
energy of the final state particles, given by: 

AE/E = 30%/ VE © 1%, for leptons , (11) 
= 80%/ VE © 5%, for hadrons , (12) 

where © indicates that the energy dependent and independent terms are 
added in quadrature. 
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Figure 3: Sample tree level Feynmann diagram for W + ljet production 

To enhance the signal relative to the background, we want to make cuts 
on vi, which should be sharply peaked at m t for the signal. To experimen- 
tally determine one must reconstruct Pt = Pb + Pi + Pu t • The neutrino is 
not observed, but its transverse momentum can be deduced from the missing 
transverse momentum. The longitudinal component of the neutrino momen- 
tum is determined by setting M^ n = My/ in Eq. (6), and is given by: 



„ XP l L ±JpHx 2 - PtiPtu: ) 

Pi = V —- 2 , (13) 

Pti 



where 



and pi and px refer to the longitudinal and transverse momenta respectively. 
Note that there is a two fold ambiguity in this determination. We chose the 
solution which would best reconstruct the mass of the top quark. In some 
rare cases, the quantity under the square root in Eq. (13) is negative. When 
this happened, we set this square root to zero, and used the corresponding 
result for the neutrino longitudinal momentum. 



Background Calculation 

The main source of background to the direct top quark production is pp — > 
W + 1 jet. A sample tree level Feynmann diagram for this process is shown 
in Fig. [| Another background process is standard model single top quark 
production when the associated jets are not observed. Examining the data 



presented in Ref. [Jl8l , we conclude that single top production is less than 
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Figure 4: \/I distributions for the (a) basic and (b) optimized cuts without 
b-tagging at the upgraded Tevatron. The solid line represents the direct top 
product ion (k c / A = 0.2 TeV^ 1 ). The dashed line is one thousandth of the 
W + 1 jet background. The vertical axis is da/d\/i in pb/GeV, and the 
horizontal axis is \/§ in GeV. 



1% of the W + 1 jet background when b-tagging is not used. When b- 
tagging reduces the W + 1 jet background by a factor of 100, the single 
top background may be as large as 20% of the total background. However, 
since the discovery limit on k/A scales as fl"* where B is the number of 
background events, a 20% change in the background affects the discovery 
limit by only 5%. We therefore ignore this background. 

We used the VECBOS monte-carlo [EH] to calculate the cross section for 
the W + 1 jet background. We modified the program to produce the same 
distributions that were calculated for the signal, and applied the same basic 
cuts used in the signal calculation, Eqs. (7-10). To determine additional cuts 
which optimize the discovery limits on k/A, we examined the kinematic dis- 
tributions in p T , r], and AR. We found that three distributions, y/1, Prb, 
and r)i, were most useful in isolating the signal from the background. These 
are shown in Figs. f|, [5], and |6], with the charm quark in the initial state and 
k c /A = 0.2 TeV for the upgraded Tevatron. The solid lines represent direct 
top production, and the dashed lines represent the W + 1 jet background 
divided by 1000. The cuts were optimized for each of four cases: Run 1 
at the Tevatron with pp collisions at y/s = 1.8 TeV and 100 pb -1 of data 
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Figure 5: pxb distributions for the (a) basic and (b) optimized cuts without 
b-tagging at the upgraded Tevatron. The solid line represents the direct top 
production(/t c /A = 0.2 TeV^ 1 ). The dashed line is one thousandth of the 
W + 1 jet background. The vertical axis is da/dp Tb in pb/GeV, and the 
horizontal axis is pxb in GeV. 





{PTbjmin 


( V^S ) min 


( Vs) max 


{j1l)max 


1.8 TeV Tevatron 


35 GeV 


155 GeV 


205 GeV 


1.8 


2 TeV Tevatron 


45 GeV 


160 GeV 


205 GeV 


1.0 


14 TeV LHC 


35 GeV 


165 GeV 


195 GeV 


1.0 



Table 1: Optimized cuts for direct top quark production 



per detector, Run 2 with yfe = 2.0 TeV and 2 fb , Run 3 with 2.0 TeV 
and 30 fb -1 , and the LHC with pp collisions at 14 TeV and 10 fb -1 . The 
optimized cuts are shown in Table [|. The corresponding distributions with 
the up quark in the initial state are not shown; they have the same shape as 
for the charm quark, but are a factor of ten larger in magnitude, due to the 
much larger size of the valence up quark distribution in the initial state. 

To further reduce the background, we assumed that silicone vertex tag- 
ging of the b jet would be available, with 36% efficiency at Run 1 of the 
Tevatron, and 60% at Runs 2 and 3, and at the LHC. In addition, we as- 
sumed that 1% of all non-b quark jets would be mistagged as b quark jets. 
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Figure 6: rji distributions for the (a) basic and (b) optimized cuts without 
b-tagging at the upgraded Tevatron. The solid line represents the direct top 
production(/t c /A = 0.2 TeV -1 ). The dashed line is one thousandth of the 
W + 1 jet background. The vertical axis is da/drji in pb, and the horizontal 
axis is rji. 

When b-tagging is present, if the jet produced is mistaken as a b jet, 
it remains a part of the background. The background can be reduced by a 
factor of 100 if the W + 1 jet sample does not include a significant fraction of 
b quarks in the final state. It is possible to estimate the fraction of b quarks 
in the W + 1 jet sample by taking the ratio |Kfe| 2 /|Kid| 2 and multiplying by 
the ratio of the distribution fraction of charm quarks to up quarks in the 
proton(^ 0.1). We estimate that the fraction of b quark jets in the W + 1 jet 
background is less than .03%, much less than the anticipated mistagging rate 
of 1%. We therefore ignore the possibility of having b quarks in the W + 1 jet 
sample. Including b-tagging does not significantly affect the optimized cuts. 

Results and Discussion 

We can use the results of the signal and background calculations to determine 
the minimum value of k c /A or k u /A observable at hadron colliders. Assuming 
Poisson statistics, the number of signal events (S) required for discovery of a 
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Luminosity 


background 


signal needed (fb) 




TeV 


fb" 1 


fb 


w/ b-tag 


w/o b-tag 


Run 1 


1.8 


0.1 


19400 


1370 


190 


Run 2 


2.0 


2 


13000 


245 


27 


Run 3 


2.0 


30 


13000 


63 


6.4 


LHC 


14 


10 


79000 


267 


27 



Table 2: Signal needed for the discovery of anomalous t-c-g and t-u-g cou- 
plings at the Tevatron and LHC at 95% confidence level. The background 
cross sections use the optimized cuts described in Table |l]. 





Tevatron 


LHC 


1.8 TeV 


2 TeV 


14 TeV 




b tagging? 


.lfb- 1 


2/6- 1 


30/&- 1 


10/6- 1 


charm 


no 


.38 


.14 


.073 


.020 




yes 


.22 


.062 


.030 


.0084 


u quark 


no 


.096 


.045 


.023 


.0081 




yes 


.058 


.019 


.0094 


.0033 



Table 3: Discovery limits on k c /A and k u /A at the Tevatron and LHC. The 
results are reported in TeV -1 



signal at the 95% confidence level is: 

S 



VsTb 



>3, (15) 



where B is the number of background events obtained by multiplying the 
background cross section by the luminosity and dividing by 100 if b-tagging 
is present. The luminosity, background cross section, and signal cross section 
needed for discovery of anomalous flavor changing couplings is given in Table 
^. The discovery limits may then be determined by comparing the signal 
calculation for a given k/A to the signal needed, which can be obtained from 
Table |2|. These discovery limits are shown in Table 0. 

The results quoted in this paper all use the MRSA structure functions. 
When using the CTEQ3M structure functions, the direct top cross section 
increases by 15% when the charm quark coupling is used, corresponding to 
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a 7% improvement in the discovery limit for k c /A. This is primarily due 
to a larger charm quark density in the proton with the CTEQ3M structure 
functions. The W^ + l jet cross section does not change significantly, nor does 
the direct top cross section when the up quark coupling is used. 

We considered cases with and without b-tagging for each of the possibil- 
ities in Table [| With the exception of Run 1 at the Tevatron, b-tagging 
improved the discovery limit on k/A by 2.0 — 2.5 times. However, for the 
data from Run 1 at the Tevatron, b-tagging improves the discovery limit by 
only 40%. This is mostly due to less efficient b-tagging, and to the smaller 
number of events available with a lower luminosity. 

In some single top quark production processes, there are regions of over- 
lap between, for example, 2 — > 1 subprocesses and 2^2 subprocesses. In 
particular, we worried about an overlap between the direct top production 
and the gluon fusion diagram in which one of the gluons is dissociated into 
a cc pair, and the c combines with the other gluon to produce a top quark. 
Care must be taken with these processes to avoid double counting. A sys- 
tematic method exists for calculating a subtraction term which solves this 
difficulty |18|, |i~9| . The effect of the double counting is most significant if the 
initial state particles are massive. In the case of direct top quark production 
due to anomalous t-c-g or t-u-g couplings, the initial state particles are light 
enough that this does not significantly affect the overall cross section. We 
have therefore ignored this effect in our calculation. 

Although the background due to single top quark production (a top quark 
with an associated jet) is small in the SM, there exists also the possibility 
for single top quark production with the anomalous t-c-g (or t-u-g) coupling, 
e.g. via qq — > tc (qq — > tu). If the jet associated with the top quark is not 
seen, this would enhance the direct top signal due to the anomalous coupling. 
Therefore, the discovery limits quoted in Table |3] are conservative estimates 
of the level to which k/A may be probed. A full treatment of single top 
production due to the anomalous t-c-g and t-u-g couplings will be considered 
elsewhere. 

In conclusion, we have calculated the discovery limits for the anomalous 
chromomagnetic couplings t-c-g and t-u-g in hadron colliders using direct 
production of an s-channel top quark. We conservatively estimate that an 
anomalous charm quark coupling can be detected down to k c / A = .06 TeV -1 
at Run 2 of the Tevatron, and .009 TeV -1 at the LHC. The cross section for 
the anomalous up quark coupling is larger, and we can measure k u /A down 
to 0.02 TeV" 1 at Run 2 of the Tevatron, and 0.003 TeV -1 at the LHC. The 
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discovery limits for the upgraded Tevatron are approximately two (six) times 
better than those obtained in Ref. [15| for k, c /A (k u /A). The relative size 



of the direct top production and the anomalous top decay rate will help to 
differentiate the t-c-g and the t-u-g couplings. 

Finally, we note that, in Ref fllPl , the authors found that electroweak- 
like corrections in a supersymmetric model can give Br(t — > eg) as large as 
1 x 10~ 5 for the most favorable combinations of the parameters. In terms 
of our anomalous coupling parameter, this corresponds to n c /A = 0.0033. 
If supersymmetry is the only source for the anomalous t-c-g coupling, our 
calculations therefore indicate that future improvements at the LHC will 
be needed to make this a detectable signal, unless QCD-like corrections 
further enhance the SUSY contributions, as discussed in Ref. JTDI . 
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